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ABSTRACT 

Some 300 reviews of non-fiction, young adult books 
were examined to see if they contained information needed by 
librarians. Six essential items were identified: authoritative 
treatment, comparisons with ether books, a scope statement, a 
description of the author's background, a basis of work statement, 
and a purpose statement. The study was limited to the November 1971 
through August 1972 issues of School Library Journal, Library 
Journal, and Publisher's Weekly. Frequency data tables were compiled 
and analyzed statistically. The average occurrence of any criteria 
was about 50 percent. It was concluded that the reviews are 
inadequate to aid a librarian in intelligent book selection. A 
further study using more review journals is recommended. (PF) 
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PREFACE 



This paper explores an essential tool employed in book selection, 
the book review. The exploration is directed to the v/ritten contents 
of reviews of juvenile nonfiction books applicable in grades 7 - 12, 
The focus will be to compare the written statements included in diff- 
erent publishers reviews to determine if these publishers make state- 
ments which are considered to be important in analyzing the review for 
the purpose of selecting titles. Consideration of v;hat are important 
statements will be based primarily upon recommendations and modifications 
proposed by Helen Haines in her book, Living With Books . 
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INTRODUCTION 

The Public and school librarians who seek to build or to expand 
collections of nonfiction titles for youngsters in grades 7-12 have a 
formidable job. It is formidable since the titles selected must be ap- 
propriate for a wide range of reading abilities as well as a wide range 
of content areas. Each librarian must rely on whatever information 
sources he has in order to make decisions. 

Last year alone., over 27 ,000 new titles were published as well as 
over 10,000 nev7 editions (Tryon) . Of these numbers only about 75% of 
them were reviewed, but in a great number of journals and periodicals. 
In the nonfiction area alone there is estimated to be several thousand 
new titles. The librarian needs to rely on the reviews nf these titles 
in order to determine the suitability of them for inclusion in his collec- 
tion. Absent the actual book itself or absent the content credentials or 
experience necessary to make a sound evaluation in the nonfiction area, 
the decision making process he employs in selecting titles must neces- 
sarily remain arbitrary. 

The librarian must not only concern himself with how appropriate the 
nonfiction titles are for his young patrons but he must also consider the 
potential effect of controversial titles on the faculty, parents and the 
community as a whole. If titles treat subject areas that quej';tion estab- 
lished social institutions or their values then it is likely that pressures 
will, be brought to bear against the librarian as well as his supervisors, 
even if a book selection policy exists that accepts controversial titles. 
Regardless of whether a policy exists or not, information should be made 
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available to assist the librarian in selection-. The reviews should not 
only provide bibliographic information and statements of contents but 
should also, in the judgment of this writer, provide information suffi- 
cient to signal the librarian of possible areas of sensitivity. In no 
way do I imply that the review bo a censorship tool but it should make 
statements V7hich will assist librarians in building their collections 
in the face of changing community attitudes.' 
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PURPOSE OF THE STUDY 

This study is exploratory in nature. It attenpts to examine the 
\in:itten contents of nonfiction book reviews to connare stateinents from 
reviews v/hich tend to indicate the presence or absence of certain infor- 
mation. Statistical analyses are then conducted on the frequency of 
occurrence of such statements. Such analyses will indicate if there 
are differences in the reviewin^^ practices employed hy three pub- 
lishers. 

In analyzing; the reviews this author does not focus upon standard 
bibliographic information such as author, title, date of publication, 
cost, paf^ination, etc. Such information is necessary and would norm.ally 
be expected to be included in reviews. The focus is on what reviex-^ers 
explicitly state or fails to state in the reviews. 
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SACKOROUMD 



Book reviewing is essential in order to provide substantive infor- 
mation about the f^reat numbers of new titles and editions published each 
year. Most individual librarians rely upon reviews to assist them in 
selection, but there are a threat number of problems associated with the 
practice of reviewinf?. Some of these problems will be mentioned here 
but it is not the purpose of this paper to compile a list of problems 
associated with reviewing. Certainly the fact that about 25% o^" books 
published in the United States do not y>et reviewed is a serious problem. 
Another problem is the fact that revievrinp, occurs in over 20,000 differ- 
ent neriodicals. Reviews vary greatly in lenj^th and what may be called 
"quality." Short reviews are found mostly with fiction and children's 
books with philosophy, history and biographies having the longest re- 
viev7S. (Tryon, 1972). Some studies have indicated that unfavorabl.e 
reviews tend to be the lont^est in len^^th, while those that are noncom- 
mittal are usually the shortest. (Trvon, 1972). 

In 1929, ^^onroe and Hull conducted a study which set forth some cri- 
teria for judf7in?> review adeauacy. They considered the frequency with 
v/hich books were reviev/ed and also the characteristics and sources of 
reviews. Very little emphasis V7as focused on contents of reviews them- 
selves. In 1946 Schultze studied the time interval between publication 
and review and observed that as many as 30% of reviews did not appear un- 
til 6 months after publication. She stron<>ly urp;ed a change in rev±e\-j 
editing policy. However, Peyre (1963) criticized the f'act that many 
reviews appear at once resultinc^ in undue attention on the title. 
After studying leadint^ review periodicals for children's literature, Estes 
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(1964) found that although bibliographic information was adequate in re- 
views in that area, the description of contents were less valuable for 
selection purposes. Indeed, according tc her scale, she found that 
children's reviews were about 50% effective in their description for 
evaluating the quality of the book. 

Gardner (1964) investigated 46 reviewing journals which focused on the 
physical sciences. She found general bibliographic information to be com- 
plete for the most part but also found that the average time a review took 
ranged between 6 and 11 months. She did not report on the contents of the 
reviews • In another area of reviewing, Boyd (1967) examined the number of 
reviews published per title to determine if any areas existed which re- 
ceived more attention. This search for area bias resulted in. the conclu- 
sion that a large percentage of juvenile nonfiction is inadequately cov- 
ered by reviews and that some subject areas in the nonfxction category are 
covered better than others. 

Alice Lohrer examined four periodicals which are used by almost all 
school and public libraries: Booklist , Bulletin of the Center for Child- 
ren's Books , Horn Book ^ and School Library Journal . She compared their 
reviews to see if there was a difference in their quality or styles and 
also on their coverage. The reviews from the Bulletin for the Center of 
Children's Books received the highest rating quality, but this periodical 
also proved to be the most dip criminating in the books which it chose to 
recommend. It reviewed slightly under half the books published and re- 
commended only about one sixth of them. Horn Book , which covered about 
one third of the titles published, also received a high rating by Lohrer « 
Horn Book reviews only books it recommends. Booklist has the same policy. 
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The School Library Journal was found to revie^^ about 85% of children's 
titles and recoinmend half of them. . Lohrer found that the School Library 
Journal was also the least critical among the review publishers and she 
found the quality of reviews to be quite uneven. 

There appears to be a lack of published studies which focus upon what 
is written in the contents of book reviews. Perhaps this is due to the 
difficulty in getting people to agree on what should be in a review. 
Perhaps it is due to the lack of interest in the area or the difficulty 
in treating the data. Regardless of the reasons for the current state 
of affairs, it would appear that an exploratory effort should be exerted 
to examine this area. 
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REVIEWING CRITERIA 



Helen Haines (1935) in her noted publication. Living With Books ^ 
stated, "In the general field of book reviewing the prevailing attitude 
today is 'not critical/ but rather one of 'enthusiastic appreciation' or 
'noncommittal acceptance'/' Furthermore, "A deliberately censorious 
approach, a chronically caustic characterization, is found in very few 
reviewers." According to the comments and opinions offered by a number 
of people who have examined book reviews (since Haines) there appears to 
be little change today in 1973. Book reviewing appears to be a highly 
subjective activity as reflected in the use of the terms to describe re- 
views. The terms 'favorable', 'noncommittal' and 'enthusiastic apprecia- 
tion' certainly are broad generalizations as used in 1935 or today. Is 
a review 'favorable' because the reviewer has a preference for the author 
or topic or knows someone acquainted with someone else or enjoys going to 
review parties? Or is a review favorable for what the title represents? 
Is a review 'noncommittal' since the author is not likely to make lit- 
erary history with his effort, but really hasn't written something socially 
unacceptable? Or is a review considered 'noncommittal' since the reviewer 
is attempting to establish himself in the field and it would not be proper 
to be critical or analytical with his initial efforts. No doubt these and 
other factors enter into the 'quality' of a review. Reviews, however 
should possess certain basic information and as times change, so should 
the basic information. But, as Haines cautions , (p .99) , "There are no rigid 
rules binding critical judgment to a given formula. In book reviewing, as 
in every human activity, there are 'many men of many minds'." And she 
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further suggests that the contents of reviews (p. 99) "will be influenced 
by the standards of judgment that the individual critic accepts and 
applies - whether traditional or erudite . . , factual and ironic . . . 
or sensitive and psychoanalytical/' She cautions, however, that there 
are limits to individual critical judgment and passed those limits, "we 
enter into a region of bad taste and fatuous opinon. , , . "(p .100) 

Haines clearly identifies a problem that is frequently encountered in 
book reviewing. It is of expressing the reviewer's 'standard of jud.gment.' 
The standards must necessarily be varied for each reviewer as a reflection 
of his or her background experiences and total philosophy. However, Haines 
suggests that there should be certain common standards and recommends a 
list of inclusion statements of what constitutes the "Fundamental qualities 
of good book reviewing..." (p. 98) These fundamental qualities include; 

1. Good literary form, 2. Authoritative treatment, 3. Comprehen- 
siveness, 4. Unbiased judgment. 

Haines expands this list v/hen considering books in the nonfiction and 
science area to include: 5. Form of book, 6. Author's qualifications, 
7. Basis of work, 8. Purpose, as well as other bibliographical informa- 
tion for acquisition purposes. 

This is the list of qualities that is recommended hy Haines for inclu- 
sion in the review of books, and more specifically, nonfiction titles. 
Each of these eight qualities will now be examined to determine whether or 
not they should be included in a list of criterian statements which will 
be applied to evaluate nonfiction juvenile reviews. 

For each of the eight recommended qualities, several questions will be 
asked after stating fully what Haines expressed in her book relative to 
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that quality. 

1. "Good Literary Form. Expression should be easy and effective 
though it may vary greatly in manner, from the leisurely and graceful to 
the dynamic and analytical/' 

How does a reviewer determine 'literary form'? How does a reviewer 
determine if the literary form is 'good'? How does the librarian 
recognize a statement of literary form in a review? How does the 
librarian judge what is meant by 'good' and if there are no statements 
present, does it mean that the literary form was not ^ood or did the 
reviewer simply forget to place it in the review? 

Literary Form is a difficult characteristic to measure from a re- 
view and for the purpose of this study, no attempt will be made to 
search for statements of literary f oira. 

2. Authoritative treatment: It should be written by someone who has 
read the book and knows something (the more the better) about the subject 
presented. This need not be profound, scholarly erudition; often there is 
more practical effectiveness in the broader, more flexible, mastery gained 
from a good background of information, wide book knowledge, and experienced 
critical judgment. The leading review periodicals aim at the expression 

of sound authority but this does not generally prevail. 

A librarian can determine if the reviewer is a person x^ho has some 
background in the area if there is a statement to this effect included 
in the review. What appears to be at issue here is the author's quali- 
fications to be able to write a review on the contents of the book. 
It would appear that familiarization with the subject content would 
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be important to be able to write authoritatively on the titl^i. 
Familiarization v;ith subject content perhaps can be associated with 
his educational experience or degrees, but there need not be any 
correlation at all with these two variables. 

Statements of authoritative treatment can be recognizable in a 
review. Such statements would be identified by some expression of 
the reviewers background, qualifications, or experience. Therefore, 
a review inclusion criteria will focus on the search for AUTHORITATIVE 
TREATMENT . 

3. Judicious comparison with other books in the same fields or with 
work of similar character. 

A librarian reading a review would benefit by the comparison of 
the Title being reviewed with other similar titles. It is a rather 
simple task to determine if the reviewer made such a comparison in 
reading the reviev; itself. The tern judicious, however, is value 
laden. 

Statements of comparison with other books can be recognized in 
a review. Therefore, one review inclusion criterion will be to 
search for BOOK COMPARISON statements. No effort will be made to 
measure the judiciousness of such statements. 

4. Comprehensiveness: It should cover most of the points that have 
already been noted as important in testing book values, i.e., authority, 
scope, form, treatment, literary quality, and physical characteristics. 

Comprehensiveness is a broad term covering several 'points'. 
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A search for AUTHORITY will be conducted as indicated in nuniber 2. A 
search for statements about the SCOPE of the book will be included 
also. Statements of form, treatment and literary quality will not be 
searched for because of the subjective and arbitrary nature of these 
terms. Although physical characteristics of the book are important, I 
would expect most reviews to have them and earlier studies have com- 
mented on their inclusion in reviews.. No search will be conducted for 
the physical characteristics of the book in the review. 

Statements of the SCOPE with which the author of the book treated 
the usbject can be recognized in a review. Therefore, one review in- 
clusion criterion will be to search for statements on the SCOPE with 
which the author treated the subject. 

5* Unbiased judgment: It should, so far as possible, be free from 
personal prejudice of the reviewer and uninfluenced by the editorial 
point of view of the publication. Many reviewers — among them some of the 
most brilliant and penetrating critics — are biased, either by antagonisms 
or sympathies . 

Unbiased judgment is a broad subjective characteristic which 
would be difficult to determine by reading a review. Although it is 
not impossible to determine if a review is biased or not, recognition 
of what are considered to be biased statements in a review must neces- 
sarily be arbitrary and for the purpose of this study, is not consid- 
ered. There will be no search for biased or unbiased statements, this 
would constitute a research project in itself. 
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6. Form (such as textbook or manual, elementary or advanced; refer- 
ence work; professional monograph or treatise; presentation for the gen- 
eral reader) . 

The reviews to be analyzed will be limited to the nonfiction area 
for juveniles in grades 7-12. Reviews of reference works will not 
be included, 

7. Author's qualifications are of prime importance, in denoting both 
scientific authority and degree and kind of research represented. Work 
of first-hand authority in science is as a rule closely specialized; a 
biologist does not write on geology, an astronomer does not expound eu- 
genics. But there are many works that represent summary or synthesis or 
interpretation rather than original research and knowleds^e of the author's 
scientific background is a guide in appraisal of their authority* 

Author's qualifications can easily be determined by some state- 
ments in the review. A search will be conducted for such statements. 
AUTHOR'S QUALIFICATIONS, 

8. Basis of work, though often implied in an author's qualifications ^ 
should be clearly understood. As in the case of history, it may represent 
source material of first-hand research, exact experimentation and trained 
observations; or material of first-hand value drawn from untrained obser- 
vation; or secondary material presented with skill and authority, or 
weakened by superficial or ill -balanced handling. It should be remembered 
that source material of science is rarely comprehensible to the nonscienti- 
fic reader. 
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Reviews of nonfiction titles should include statements which ex- 
press the basis of the work. Although opinions are often accepted, 
they are often based upon extrapolation of data. Therefore, one 
review inclusion criterion will be to search for statements on the 
BASIS OF \>JORK used by the author. 

9. Purpose, if not sufficiently indicated in form, should be ascer- 
tained — whether it is to record observations and results, to disclose a 
special body of toowledge, to summarize and generalize In broad survey, 
to expound a theory, to analyze or criticise the work of others, or to 
express a particular point of view, appeal to a particular group of read- 
ers. 

Reviews of nonfiction titles should include statements which ex- 
press the PURPOSE of the work. Therefore one review inclusion cri- 
terion will be to search for statements on the PURPOSE of the work. 
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To sumarize^ the iuvenile nonfiction reviev;s will be searched for 
stateinents of the following;: 

1. A statement about AUTHORITATIVE TREATMENT, focusing: on the re- 
viewer's background. 

2. A statement about BOOK CO>fPARISni:, focusine, on comparison of the 
title with other titles. 

3. A statement about SCOPE, focusinj> on how extensive the subject 
was covered. 

4. A statement about AUTHOR'S OUALIFICATIOM, focusing on the author 
himself. 

5. A statement about BASIS OF WORK, focusin?? on how the author ob- 
tained information for his work. 

6. A statement about PURPOSE, focusinc^ on the reasons for writinj> 
the work. 

These inclusion criteria were . deT.ived from the list provided by Helen 
Haines. A librarian v/ould necessarily need this basic list of information 
in order to be able to make a sound decision in selecting: the title. This 
study examines whether these statements are included in three review 
journals . 
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EXPERI>!ENTAL DESIGN 



The experimental design employed involves treatment of recorded 
nominal data. Preliminary efforts to find and use ordinal , interval , or 
even ratio scales for more extensive review analysis treatment of data were 
constrained by a lack of reports and research in this field. Furthermore, 
it was not the purpose of this exploratory study to develop and validate 
them. Consequentially, treatment involves constructing frequencv data 
taibles in 2x3 and 2x2 matrices and analyses of data continj>encies in 
accordance with the chi-square equations suggested by Fisher. Treatment 
also includes a summary percentage table. Results of data treatment 
from contingency tab?.eo v/ill indicate the statistical probabilities for 
frequencies of occurrence of recorded data. 

For this study the level of probable sit>nif icance is defined at or 
less than P = 0.05. A "P" value at or less than 0.05 indicates there are 
significant differences amont> or between review journals on the specific 
inclusion criterion statement. A *'P" value j^reater than 0.05 indicates 
no significant differences exist among or between review journals on the 
specific inclusion criterion statement. 
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PROCEDURE 



Three reviewing journals, School Library Journp.l , Library Journal , 
and Publishers Weekly (hereinafter desi?;nated as SLJ, L.J., and P.VJ.) were 
used. These journals review non-fiction as well as many other titles, but 
were selected since nost school libraries and nany public and his/her ed- 
ucational libraries subscribe to and use one or piore of them. 

An intensive study of Reviewing Criteria was conducted as reported 
earlier. The focus was to determine if recommended inclusion criteria 
statements could in fact be utilized by the author to determine the pre- 
sence or absence of su^c»ested review criteria statements. As indicated 
earlier, some vxere not and therefore excluded. Six inclusion criteria 
statements v/ere selected on the basis of their bein?* reasonably identi- 
fiable by an observer. Photocopies of pap.es containing revie\^s fitting 
the criteria of non-fiction titles applicable for youn;^ adults and/or 
grades 7-12 were made from P.W., L.J., and S.L.J, issues published from 
November 1971 to August 1972. Biblioj^raphies were excluded, 

A total of 100 reviews were identified for each publisher and these 
were labeled (L.J., P.U., S.L.J.) , numbered, and cut from t:he photocopies. 

Ten reviews were randomly selected from each publisher by drawing 
from a box in which they had been shaken. A preliminary analysis of 
these thirty reviews, tin from each publisher, for inclusion criteria 
statements was made and recorded. A second observer v/as then asked to 
analyze these same thirty reviews after explaining the criteria in detail. 
Comparison of the total of 189 items bet\7een both observers was made and 
provided an. inter-observer reliability of 0.97 with 1] items in disa- 
greement . 
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After conpleting the inter-observer reliability check the remaining 
reviews fron each publisher were analyzed for inclusion criterion state- 
ments. Unfortunately, photo copies of the 300 reviews were accidentlv 
destroyed and not available for the appendix. 
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LIMITATIONS OF STUDY 



This study was planned to be exploratory. It sampled only a small 
population of reviews in a specific area of interest over a relatively 
short period of time. There was no immediate way to determine if the 
limitations just mentioned also reflect a larger population, broader 
interest areas over longer periods of time. 

Threats to the internal and external validity of the design used 
should be considered as possible limitations and include: 

1. History - There was no control over any changes in editorial 
policy during which reviews were published. Such changes would certainly 
effect the frequency of inclusion criteria statements. Also, there was 
no control over actual non-fiction subject areas that were reviewed* 

2. Maturation - The effects of the observer becoming tired, grow- 
ing hungry, growing more tired, hoping to complete the analysis and the 
like, are processes which could have effected accuracy of observation. 
Since no more than two hours at a time v;ere spent analyzing the reviews 
the effect is expected to be minimal in this study, but no quantitative 
measure was established. 

.Biases - It is possible that the author was or became biased in 
his observational analyses of reviews. A direct attempt to eliminate 
this probable confounding effect was executed by conducting an inter- 
observer reliability check before starting the study. Inter-observer 
correlation was established at 0.97 which would tend to indicate initial 
unbiased observation or suggest that both observers were biased in the 
same direction. 

4, Reactiveness - As the analyses of reviews proceeded some analyses 
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may have been confounded by specific event recordintt Datterns for each 
of the six inclusion criterion statement areas. Tliere was no examina- 
tion of these effects except a direct effort was made toward neutrality 
in analyzing each review. 
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TREATMENT AND RESULTS 



The results of treating the contingency data tables are given for 
each of the six inclusion statement criteria variables that were sum- 
marized on page 15. Although the results of treatment are given as well 
as comments, it must be reiterated that this is an exploratory research 
study and consideration should be given to the limitations and other 
threats to the internal and external validity of the design when assess- 
ing the enclosed results. 

Each variable from 1 through 6 has four possible comparisons for a 
total of 24 variables. Only those prime variables from one through six 
will receive more extensive treatment if the two by three contingency 
table (i.e., each variable, yes or no by each of the three publishers), 
results in a probability level less than 0.05. Prime contingency tables 
(2 X 3) with P levels greater than 0.05 will not receive subdivisional 
treatment. Exception to this is variable 1. 

For each variable, either prime or subdivision that is enclosed, 
three data tables are included. The first data table indicates the FRE- 
QUENCY of reviews either yes or no. This is the ra^*; count of the number 
of reviews that were actually recorded from the publishers which did or 
did not have the inclusion criterion. From the FREQUENCY table, this 
data is then used to calculate the THEORETICAL EXPECTED VALUE table. 
This second data table reflects the Expected values from against the Ob- 
served values. The second data table does not serve to provide interpre- 
tive data, only relative statistical data. The third data table, PERCENT 
AGES, will indicate the actual percentage values from the total number of 
reviews recorded in the FREQUENCY table. The PERCENTAGE table will there 



-21- 



fore provide a translation of the FREQUENCY table into percent values • 
In addition to compiling FREQUENCY values, calculating EXPECTED values 
and calculating PERCENTAGES, statistical treatments using the CHI-SQUARE 
will be applied to the values in the FPvEQUENCY table. Comparison of 
V derived CHI-SQUARE values respecting the number of degrees of freedom 
for each table will be made to determine the exact mathematical proba- 
bility that the values indicated in the FREQUENCY table could have 
occurred by chance. 

As indicated earlier, the P (Probability) level of 0.05 is the maxi- 
mum acceptable level for this study. Any P value less than 0.05 will be 
considered to be statistically significant. Values of P greater than 
0.05 will not be considered statistically significant. 
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Variable 1, page 15, a comparison of inclusion criterion statements 
on "AUTHORITATIVE TREATMENT'* for S.L.J., L.J., and P.W. 



FREQUENCY 



S.L.J. 

i 0 
100 



L.J, 
44 

55 



0 

100 



TOTAL 

44 yes reviews 
256 no reviews 



S • L • J « 

14.67 

85.33 



L.J. 

14.67 
85.33 



THEORETICAL EXPECTED VALUES 



P.W. 

14.67 
85.33 



TOTAL 
44 

256 
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S.L.J. 

0.0% 
33.33% 



PERCENTAGES 



L.J. 

14.67% 
18.67% 



P.W. 

0.00% 
3J.33% 



TOTAL 

14.67% yes reviews 
85.33% no reviews 



Chi-square equal 103.125, 2 degrees of freedom. Exact probability 
of occurrence 0.000. 

COMMENT VARIABLE 1. Since the P is less than 0.05, it is apparent that 
significant differences exist among the reviews of the three publishers, 
Examination of the FREQUENCY table clearly shows that L.J. contains a 
significantly higher number of reviews indicating '•AUTHORITi?^.TIVE 



-23- 



TREATMENT." 

Because of the unique makeup of the FREQUENCY table it is not 
necessary to proceed with subdivisional treatments. However, it is in- 
teresting to note that only 14.67% of the 300 reviews examined in this 
study contain any statements on "AUTHORITATIVE TREATMENT." 
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Variable 2, page 15, a comparison of inclusion criterion statements 
on ''BOOK COMPARISON/* Subdivisions are as follows: 
2A1 Comparison of S»L.J», L»J», and P.VJ, 
2A2 Comparison of S.L.J, and L.J. 
2A3 Comparison of S.L.J, and P.W. 
2A4 Comparison of L.J. and P.W. 
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Variable 2A1, comparison of S.L.J., L.J., and P.W. for inclusion 
criterion statements on "BOOK COMPARISON." 



TOTAL 

86 yes reviews 
21A no reviews 







THEORETICAL 


EXPECTED 


VALUES 


S • L • <J • 


L. J. 


P.W. 




TOTAL 


28.67 


28.67 


28.67 




86 


71.33 


71.33 


71.33 




214 




1 




PERCENTAGES 




1 S • L • • 


L.J. 


P.V/. 




TOTAL 


12.67% 


10.67% 


5.33% 




28.76% yes reviews 


20.67% 


22.67% 


28.00% 




71.24% no reviews 


Chi- 


-square equals 


12.6494, 2 


degrees 


of freedom. Exact probability 



of occurrence 0.00228. 

COMMENT VARIABLE 2A1 : Since P is less than 0.05 it is apparent that 
significant differences exist among the reviews of the three publishers. 
Examination of the FPvEQUENCY table clearly shows that a tendency not to 
include statements in reviews which make book comparisons exists and 
that P.W. has the lowest frequency of such statements. It is interesting 
to observe that over 71% of the 300 reviews examined did not contain 
statements on '*BOOK COMPARISON.'' 
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FREQUENCY 

S.L.J. L.J. P.W. 

38 32 16 

62 68 84 



Variable 2A2, comparison of S.L.J, and L.J. for inclusion criterion 
statements on "BOOK COMPARISON." 



1 




FREQUENCY 




S.L.J . 


L.J. 




TOTAL 


38 


32 




70 yes reviews 


62 


68 




130 no reviews 







THEORETICAL EXPECTED 


VALUES 






S.L.J. 


L.J. 


TOTAL 






35.00 


35.00 


70 






65.00 


65.00 


"130 










PERCENTAGES 








S.L.J . 


L.J. 


TOTAL 






19.00% 


16.00% 


35.00% 


yes reviews 




31.00% 


34.00% 


65.00% 


no reviews 



Chi-square equals 0.7912, 1 degree of freedom. Exact probability 
of occurrence 0.6224. 

COMMENT VARIABLE 2A2 ; Since P is greater than 0.05 it is apparent that 
no significant differences exist between S.L.J, and L.J. on this compari- 
son. However, it is important to note that 65% of the 200 reviews ex- 
amined did not contain statements on "BOOK COMPARISON." 
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Variable 2A3, comparison of S.L.J, and P,W. for inclusion criterion 



stiatienientis on 


dUUK LUnFARIbON . 






FREQUENCY 




S.L.J. 


P.W. 


TOTAL 


38 


16 


54 yes reviews 


62 


84 


146 no reviews 






THEORETICAL EXPECTED 


VALUES 


S.L.J. 


P.W. 


TOTAL 


27.00 


27.00 


54 


73.00 


73.00 


146 




i 


PERCENTAGES 




j 

i S.L.J. 

i 


P.W. 


TOTAL 


19.00% 


8.00% 


27.00% yes reviews 


31.00% 


42.00% 


73.00% no reviews 



Chi-square equals 12.2780» 1 degree of freedom. Exact probability 
is 0.0008. 

COMMENTS VARIABLE 2A3 ; Since P is less than 0.05 it is apparent that a 
significant difference exists between S.L.J, and P^W. on this compari- 
son. Examination of the FREQUENCY table shows that P.W. has signifi- 
cantly fewer reviews which contain "BOOK COMPARISON" statements. However, 
it is important to note that 73% of the 200 reviews examined did not con- 
tain statements on "BOOK COMPARISON." 

Er|c -28- 



Variable 2A4, comparison of L.J. and P.W. for inclusion criterion 
statements on "BOOK COMPARISON." 







FREQUENCY 




L.J. 


P.W. 




TOTAL 


32 


16 




48 yes reviews 


68 


84 




152 no reviews 





THEORETICAL 


EXPECTED VALUES 


L.J. 


P.W. 


TOTAL 


24.00 


24.00 


48.00 


76.00 


76.00 


152c00 



PERCENTAGES 

L.J. P.W. TOTAL 

16.00% 8.00% 24.00% yes reviews 

34.00% 42.00% 76.00% no reviews 



Chi-square equals 7.0175, 1 degree of freedom^ Exact probability 
is 0.000814. 

C0MI4ENTS VARIABLE 2A4 : Since P is less than 0.05 it is apparent that a 
significant difference exists between L.J. and P.W. on this comparison. 
Examination of the FREQUENCY table shows that P.W. has significantly 
fewer reviews which contain "BOOK COMPARISON'' statements. However, it 
is important to note that 76% of the 200 reviews examine did not contain 
statements on "BOOK COMPARISON." 
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Variable 3, page 15, a comparison of inclusion criterion statements 
on "SCOPE/' This is measure of statements which indicate how extensive 
the subject was covered. "SCOPE'' comparisons are for S.L.J*, L*J. and 
P.W. 







FREQUENCY 




S • Xj • «J . 


L.J. 


P.W. 


TOTAL 


74 


66 


68 


208 yes reviews 


26 


34 


32 


92 no reviews 








THEORETICAl. EXPECTED 


VALUES 


S . Xj • \J . 


L.J. 


P.W. 


TOTAL 


69.33 


69.33 


69.33 


208 


20.67 


20.67 


20.67 


92 








PERCENTAGES 




S • Xj • tJ • 


L.J. 


P.W. 


TOTAL 


24.67% 


22.00% 


22.67% 


69.33% yes reviews 


8.67% 


11.33% 


10.67% 


30.67% no reviews 



Chi-square value equals 1.6304, 2 degrees of freedom. Exact proba- 
bility of occurrence is 0.553. 

COMENTS VARIABLE 3 ; Since . P is greater than 0.05 it is apparent that 
there exists no significant differences among the three publishers with 
respect to review statements on "SCOPE." No further sub-divisional analy- 
sis were conducted. However, it is important to note that 69.33% of the 
300 reviews examined did contain some form of statement on "SCOPE." 
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Variable 4, page 15, a comparison of inclusion criterion statements 
on "AUTHOR'S QUALIFICATION/' Subdivisions for this variable are as 
follows: 

4A1 Comparison of S.L.J., L.J., and P.W. 
4A2 Comparison of S.L.J, and L.J. 
4A3 Comparison of S*L.J. and P.W. 
4A4 Comparison of L.J. and P.W. 
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Variable AAl, comparison anong S.L.J. , ]..J. and P.W. for inclusion 
criterion statements on "AUTHOR'S QUALTFTCATTON . " 







FREQUENCY 






S • L • tj • 


L.J. 


P.W. 


TOTAL 




38 


32 


52 


122 yes reviews 




62 


68 


48 


178 no reviews 


— 







THEORETICAL EXPECTED 


VALUES 


S.L.J. 
40.67 
59.33 


L.J. 
40.67 
59.33 


P.W. 
40.67 
59.33 


TOTAL 

122 

178 




S • L • v7 • 

12.67% 
20.67% 


L.J. 

10.67% 
22.67% 


PERCENTAGES 

P.W. 

17.33% 

16.00% 


1 

TOTAL 

40.67% yes reviews 
59.33% no reviews 



Chi-square equals 8,7308, 2 degrees o freedom. Exact probability 



of occurrence 0.0128. 

C0M?4ENTS VARIABLE 4A1 ; Since P is less than 0.05 it is apparent that 
significant differences exist: amonp, the reviews of the three publishers. 
Examination of the FREQUENCY table clearly shows that L.J. contains signi- 
ficantly fewer reviews with statements on "AUTHOR'S OUALIFICATICN," L,J, 
is followed by S.L.J, and then a considerable drop with P.W. It is impor- 
tant to note however that over 59% of the 300 reviews examined did not 
contain statements on AUTHOR'S QUALIFICATION." 
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Variable 4A2, conparison between S.L.J, and L.J. for inclusion cri- 
terion statements on "AUTHOR'S QUALIFICATION." 







FREQUENCY 






S.L.J. 


L.J. 




TOTAL 




38 


32 




70 yes reviews 




62 


68 




130 no reviews 







THEORETICAL 


EXPECTED VALUES 


S.L.J. 


L.J. 


TOTAL 


35.00 


35.00 


70 


65.00 


65.00 


130 





PERCENTAGES 




S.L.J. 


L.J. 


TOTAL 


19.00% 


16.00% 


35.00% yes reviews 


31.00% 


34.00% 


65.00% no reviews 


Chi-square 


equals 0.7912, 1 degree of 


freedom. Exact probability 



of occurrence 0.6224. 

COMMENTS VARIABLE 4A2 ; Since P is greater than 0.05 it is apparent that 
no significant differences exist between the comparison of S.L.J, and L.J. 
reviews for statements on "AUTHOR'S QUALIFICATION." It is important to 
note, however, that from the 200 reviews examined, 65% of them did not 
contain statements on "AUTHOR'S QUALIFICATION." 
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Variable AA3, comparison between S»L.J, and P.W. for inclusion cri- 
terion statements on "AUTHOR'S QUALIFICIATION /' 





FREQUENCY 




S.L.J. 




TOTAL 


38 


52 


90 yes reviews 


62 


48 


110 no reviews 






THEORETICAL EXPECTED 


VALUES 


S.L.J. 


P.W. 


TOTAL 


45.00 


45.00 


90 


55.00 

I 


55.00 


110 





PERCENTAGES 






S.L.J. 


P.W. 


TOTAL 




19.00% 


26.00% 


45.00% 


yes reviews 


31.00% 


24.00% 


55.00% 


no reviews 



Chi-square equals 3.9595 on 1 degree of freedom. Exact probability 
of occurrence 0.0404. 

COMMENTS VARIABLE 4A3 ; Since P is less than 0.05 it is apparent that 
a significant difference exists between the comparison of S.L.J, and P.W. 
on "AUTHOR'S QUALIFICATION." Examination of the FREQUENCY table indicates 
that S.L.J, had significantly fewer reviews containing statements on 
"AUTHOR'S QUALIFICATION/' than P.W. However, it is important to note 
that 55% of the 200 reviews examined did not contain any statements on 
"AUTHOR'S QUALIFICATION." 
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Variable ''lA-t, comparison between L.J. and P.W. for inclusion cri- 
terion statements on "AUTHOR'S QUALIFICATION." 



ERIC 



FREQUENCY 



L.J. 
32 
68 



P.W. 
52 
48 



TOTAL 

84 yes reviews 
116 no reviews 





THEORETICAL 


EXPECTED VALUES 


L.J. 


P.W. 


TOTAL 


42.00 


42.00 


84 


58.00 


58.00 


116 



PERCENTAGES 



L.J. 

16.00% 

34.00% 



P.W. 

26.00% 
24.00% 



TOTAL 

42.00% yes reviews 
58.00% no reviews 



Chi--square equals 8.2101 on 1 degree of freedom. Exact probability 
of occurrence 0.00454. 

COM ^IENTS VARIABLE 4A4 : Since P is less than 0.05 it is apparent that a 
significant difference exists between the comparison of L.J. and P.W. on 
'^AUTHOR'S QUALIFICATION.'' Examination of the FREQUENCY table indicates 
that L.J. had significantly more reviews that had no statements on 
"AUTHOR'S QUALIFICATION" compared with P.W. However, it is important to 
note that 58% of the 200 reviews examined did not contain any statements 
on "AUTHOR'S QUALIFICATION." 
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Variable 5, pa^e 15, a comparison of inclusion criterion statements 
on "BASIS OF WORK." Subdivisions examined for this variable include: 
5A1 Comparison among S.L.J. , L.J. and P.W. 
5A2 Comparison between S.L.J, and L.J. 
5A3 Comparison between S.L.J, and P.W, 
5A4 Comparison between L.J. and P.U. 
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Variable 5A1, comparison among S.L.J. , L.J, and P.W. for inclusion 
criterion statements on *'BASIS OF WORK,'* 







FREQUENCY 




S.L.J. 


L.J. 


P.W. 


TOTAL 


52 


70 


66 


188 yes reviei^s 


48 


30 


34 


112 no reviews 




* 




THEORETICAL EXPECTED 


VALUES 


S.L.J. 


L.J. 


P.W. 


TOTAL 


62.67 


62.67 


62.67 


188 


37.33 


37.33 


37.33 


112 








PERCENTAGES 




S.L.J. 


L.J. 


P.W. 


T0TA3. 


17.33% 


23.33% 


22.00% 


62.67% yes revievrs 


26.00% 


20.00% 


11.33% 


37 . 33% no reviews 



o 
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Cbi-square equals 7.63G7 on 2 de^,rees of freedopA. Exact probability 
of occurrence is 0.0210. 

CQM^'lEMTS ON VARIABLE 5A1 : Since P is less than 0.05 it is apparent that 
significant differences exist among the three publishers on "BASIS OF WORK.*' 
Examination of the FREQUENCY table indicates that L.J. had the highest num- 
ber of reviews with inclusion statements followed by P.W. School Library 
Journal had the least number of reviews with inclusion statements. It is 
important to note that over 62% of the 300 reviews examined did contain 
statements on "BASIS OF WORK.*' 
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Variable 5A2, 


comparison between S.L.J 


. and L.J, for inclusion cri^ 


terion statements 


on "BASIS OF V/QRK/' 






FREQUENCY 




S.L.J.- 


L.J. 


TOTAL 


52 


70 


122 yes reviev;s 


48 


30 


78 no reviews 






THEORETICAL EXPECTED 


VALUES 


S . L . «J • 


L.J, 


TOTAL 


61.00 


61,00 


122 


39.00 


39,00 


78 






PERCENTAGES 




S.L.J, 


L, J, 


TOTAL 


26.00% 


35.00% 


61.00% yes reviews 


24.00% 


15.00% 


39.00% no reviews 



Chi-square equals 6.8095 on 1 degree of freedom. Exact probability 
of occurrence is 0.00905, 



COM MENTS ON VARIABLE 5A2 : Since P is less than 0.05, it is apparent that 
a significant difference exists between the comparison of S.L.J, and L.J. 
Examination of the FREQUENCY table indicates that L.J. has significantly 
more reviews with inclusion criterion statements. It is important to 
note that only 61% of the 200 reviews examined included statements on 
'^BASIS OF WORK." 
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Variable 5A3, comparison between S.L.J, and P.W. for inclusion cri- 
terion statements on "BASIS OF WORK." 



FREQUENCY 



S.L.J. 

52 
48 



P.W. 

66 
34 



TOTAI. 

118 yes reviews 
82 no reviews 



THEORETICAL EXPECTED VALUES 



S « L « J « 

59.00 

41.00 



P.W. 

59.00 

41.00 



TOTAL 
118 
82 



PERCENTAGES 



S.L.J. 

26.00% 
24.00% 



P.W. 
33.00% 



TOTAL 

59.00% yes reviev\rs 
41.00% no reviews 



Chi-square equals 4.0512 on 1 degree of freedom. Exact probability 
of occurrence Is 0.0410. 

COMMENTS ON VARIABLE 5A3 : Since P La less than 0.05 it is apparent that 
a significant difference exists between the comparison of S.L.J. and P.W. 
Examination of the FREQUENCY table indicates that P.W. has significantly 
more reviews with inclusion criterion statements than S.L.J. It is im- 
portant to note that 41% of the 200 reviews examined containe d no state- 
ments on "BASIS OF WORK." 
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Variable 5A4, comparison between L.J. and P.W, for inc].uslon cri- 
terion statements on "BASIS OF WORK." 



L.J. 

70 

30 



FREOUENCY 



66 
34 



TOTAL 

136 yes reviews 
64 no reviews 



L.J. 

68.00 

32.00 



THEORETICAL EXPECTED VALUES 



P.W. 

68.00 
32.00 



TOTAL 
136 
64 



L.J. 

35.00% 
15.00% 



PERCENTAGES 



P.W. 

33.00% 
17.00% 



TOTAL 

68.00% yes reviews 
32.00% no reviews 



Chi-square equals 0.13676 on 1 degree of freedom. Exact probability 
of occurrence is 0.5517. 

C 0M?-1ENTS ON VARIABLE 5A4 : Since P is greater than 0.05 it is apparent 
that there is no significant difference in comparing L.J. and P.W. on 
"BASIS OF WORK." It is important to note that 32% of the 200 reviews 
examined did not contain statements on the "BASIS OF WORK/' 
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Variable 


6, page 15, 


a comparison of 


inclusion criterion statements 


on "PURPOSE" 


among S.L.J. 


, L.J. , and P.W. 








FRKQUENCY 


^ 


S.L.J. 


L.J. 


P.W. 


tot;j. 


72 


76 


66 


214 yes reviews 


28 


24 


34 


86 no reviews 






THEORETICAL EXPECTED 


VALUES 


S.L.J. 


L.J. 


P.W. 


TOTAL 


71.33 


71.33 


71.33 


214 


28.67 


28.67 


28.67 


86 




I 
1 
t 
k 




PERCENTAGES 




S.L.J. 


L.J. 


P.W. 


TOTAL 


24.00% 


25.33% 


22.00% 


71.33% yes reviews 


9.33% 


8.005: 


11.33% 


28,67% no reviews 



Chl-square equals 2.4777 on 2 degrees of freedom. Exact probability 
of occurrence is 0.28957. 

COMMENTS ON VARIABLE 6 : Since P is greater than 0.05 it is apparent that 
there are no significant differences among A.L.J. , L.J. and P.W. on the 
"PURPOSE." It is important to note, however, that over 28% of the 300 
reviews examined did not contain statements on "PURPOSE." 
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SUMMARY TABLE OF PERCENTAGES YES— NO FOR S.L^J., AND P.W. 



1* AUTHORITATIVE 
TREATMENT 


STATET1ENTS-N0 


STATE>{ENTS-YES 


S.L.J. 


L.J. 


P.V7. 


S.L.J. 


L.J. 


P.W. 


100% 


56% 


100% 


0% 


44% 


0% 


2w BOOK 

COMPARISON 


62% 


68% 


84% 


38% 


32% 


16% 


3. SCOPE 


26% 


34% 


32% 


74% 


66% 


68% 


4. AUTHOR'S 

QUALIFICATIONS 


62% 


68% 


48% 


38% 


32% 


52% 


D. BASIS OF 
WORK 


48% 


30% 


34% 


52% 


70% 


66% 


6. PURPOSE 


28% 


24% 


34% 


72% 


76% 


66% 


AVERAGES FOR 
1-6 COMBIKKD 


54% 


47% 


55% 


46% 


53% 


45% 


AVERAGE FOR 
2-6 COMBINED 


44% 


45% 


46% 


56% 


55% 


54% 
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CONCLUSION 



On the basis of this data analyzed and limitations of the study it 
appears clear that significant differences do exist amons> publishers on 
the frequency of inclusion criterion statements in their reviews of non- 
fiction titles applicable to grades 7-12 and/or youn?; adults. 

Inclusion statements on ''AUTHORITATIVE TREATMENT" require further 
examination. T\'jo publishers, S.L.vT. and P. 17. did not have any. Less 
than half of L.J. reviews included them. Is this sufficient information 
needed by librarians? The author would disagree but perhaps editorial 
policy and the economics of publishing nitij^ate against its inclusion. 

Inclusion statements about "BOOK COMPARTSOri" need close examination, 
'lliere were significant differences betv/een S.L.J, and P.VJ., o-lso -L.J. and 
P.W, P.V/- had the fev/est reviews with "BOOK COMPARISON" statements. How - 
ever, over 70% of the 300 reviews examined had no statements vhich com- 
pared the book being reviewed with others in its field. The question of 
the need to have book comparisons can perhaps be challenged but in the 
author's judgment would be specious in view of the need to make selection 
decisions in other than blanket order format. 

Inclusion statements about "SCOPE" of work resulted in no significant 
differences amonj: tlie three publishers. Sixty-nine percent (69%) of 300 
reviews contained some ^^orm of statement on "SCOPE." Should not a li- 
brarian expect 100% of reviews to state the scope of non-fiction work in 
the title reviewed? 

Inclusion statemen'js on "AUTHOR'S QUALIFICATION" were found to be 
significantly higher in P.W. than L.J. or S.L.J. However, only 52% of 
Publisher's Weekly *s reviews had these statements. This author believes 
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it is important to have more than a Al% average of all reviews contain 
statements on the qualifications of the Title's author. 

Inclusion statements on the *'BASIS OF WORK'* were found to differ 
significantly among P.W,, L.J., and S.L.J. School Library Journal had 
the fewest (52%) with P.W. (66%) and L.J. (70%). An averas^s of 63% for 
all reviews does not seem to be a desirable mean for these three journals. 

Inclusion statements on the ^'PURPOSE" of a work were examined and 
no significant differences were found amoti|^ the publishers, Slip;htly 
over 71% of all reviews did contain statements of purpose. ITiis figure 
would seem to be too low. 

Although it is important to statistically massage data and obtain 
differences among publishers reviews and also between the presence or 
absence of recommended inclusion criteria statements, it is, however, 
inescapably clear that even v7ithout statistical treatments, the reviews 
examined from each of the three publishers fail to meet even minimal 
staxidards suggested by Helen Haines. Perhaps economic realities do not 
permit attaining ideal reviews for nil titles, but It is not unreasonable 
to expect the presence of basic information to assist librarians and others 
in the area of book selection through reviews. 

If, as Jesse Shera has stated. 

There is no sbustitute for substantive scholarship. The 
librarian, then, must have subject competence, a sharp 
critical sense, and the courage to buy those books which 
he believes will contribute most to the intellectual re- 
sources of his clientele 

then it would seem since librarians cannot be expected to have unusual 

substantive scholarship in the many exist^.n^; and emerging non-fiction 

areas, that better reviews and reviewing tools should be available. 
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RECOMMENDATIONS 

1. The first recommendation is to replicate this research but this time 
take all reviews for a full year from the three publishers. 

2. After replication, further research should center on analysis of non- 
fiction reviews in other journals and across age levels. 

3. Subject areas in reviews should be catagorized and analyzed as in- 
dependent variables. 

4. Extensive use of computer analysis would be effective in reducing 
"BIAS", "MJ^TURATION," and "REACTIVENESS EFFECTS." This can be 
accomplished by enterinj> the entire review contents for automated 
analysis, using agreed upon terms. 

5. Editors of book review journals should be made aware of the results 
of this research. 

6. Librarians, whose responsibilities include book selection, should be 
made aware of the results of this research. 

7. Faculty members in library science and their students should be inade 
aware of this research and indeed challenge students to replicate or 
improve the study. 

8. Reviews of non-print materials should have established standards for 
inclusion criteria statements. This is an area of rich potential 
research. 
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